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1"^ ' We consider random walks on the set of all words over a finite alphabet such that in each step only the last two letters 

^ . of the current word may be modified and only one letter may be adjoined or deleted. We assume that the transition 

n^ probabilities depend only on the last two letters of the current word. Furthermore, we consider also the special case of 

random walks on free products by amalgamation of finite groups which arise in a natural way from random walks on 
the single factors. The aim of this paper is to compute several equivalent formulas for the rate of escape with respect 
to natural length functions for these random walks using different techniques. 
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^. : 1 Introduction 

(^ ' Let ^ be a finite alphabet and let A* be the set of all finite words over the alphabet A, where e is the 

OO . empty word. Furthermore, let Z : ^ — > [0; oo) be a function representing a 'letter length' . The extension of 

^^ ' llo A* defined by l{ai . . . a„) = X^ILi Ko-i) gives then a suitable 'word length'. We consider a transient 

Markov chain {Xn)nefio oi^ ^* ^i'^^ Xq = e such that transition probabilities depend only on the last 
two letters of the actual word and in each step only the last two letters may be modified and only one 
letter may be adjoined or deleted. We are interested in whether the sequence of random variables l{Xn)/n 
C^ ' converges almost surely to a constant, and if so, to compute this constant. If the limit exists, it is called 

the rate of escape, or the drift with respect to I. In this paper, we study this question for random walks 
on regular languages and on free products by amalgamation of finite groups, which form special cases of 
regular languages and are a generalization of free products of groups. 

It is well-known that the rate of escape w.r.t. the natural word length exists for a random walk on a 

finitely generated group, which is governed by a probability measure on the group. This follows from 

Kingman's subadditive ergodic theorem; see Kingman (Ol), DeiTiennic (bh and Guivarc'h (HO). There 

are many detailed results for random walks on free products by amalgamation: Picardello and Woess 

showed that a locally compact free product by amalgamation of compact groups acts naturally on 
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a tree. They also derived the behaviour of the n-step transition probabilities. Cartwright and Soardi (0) 
investigated random walks on free products by amalgamation, where the amalgamating subgroup is finite 
and normal. They derived a formula for the Green function G{z) = X]n>o P*^""* (^' s)-^"' where p'"^ (e, e) 
is the n-step return probability from the identity e, of the random walk on the amalgamated product in 
terms of the Green functions of the single factors that is essentially the same as in Woess (E3[). For random 
walks on free products of finite groups Mairesse and Matheus ( p^ have developed a specific technique 
for the computation of the rate of escape. For this purpose, they have to solve a more elegant system of 
algebraic equations than we have to solve, but our results will be more general. Three different formulas 
for the rate of escape of random walks on free products of graphs and groups are derived in Gilch (||). The 
techniques used in @ were the starting point for the computation of the rate of escape in this paper. An 



important link between drifts and harmonic analysis was obtained by Varopoulos (22 ). He proved that for 
symmetric finite range random walks on groups the existence of non-trivial bounded harmonic functions 
is equivalent to a non-zero rate of escape. The recent work of Karlsson and Ledrappier ( |l4 ) generalizes 
this result to random walks with finite first moment of the step lengths. This leads to a link between the 
rate of escape and the entropy of random walks; compare e.g. with Kaimanovich and Vershik (111]) and 
Erschler (||). 



We also consider random walks on regular languages which can be seen as a generalization of free 
products by amalgamation. Random Walks on this class of structures have been investigated by several 
authors: Malyshev (|l7|), ( p^ and Gairat, Malyshev, Menshikov, Pelikh (||) stated criteria for transience, 
null-recurrence and positive recurrence. Moreover, Malyshev proved limit theorems concerning existence 
of the stationary distribution and speed in the transient case and convergence of conditional distributions 
in the ergodic case; in particular, he showed that the rate of escape w.rt. the natural word length (that 
is, /(•) = 1) is constant and it is strictly positive if and only if the random walk is transient. Yambartsev 
and Zamyatin ( pS]) p roved limit theorems for random walks on two semi-infinite strings over a finite 
alphabet. Lalley (n4h also investigated random walks on regular languages. He found out that the n-step 
return probabilities must obey one of three different types of power laws. His analysis is based on a finite 
algebraic system of generating functions related to the Green function. This algebraic system is also used 
in this paper to compute explicit formulas for the rate of escape. The rate of escape has also been studied 
on trees, which may be seen as a special case of our context: Nagnibeda and Woess (|l9| Section 5) proved 
that the rate of escape of random walks on trees with finitely many cone types is non-zero and give a 
formula for it. One of the techniques used in this paper for the computation of the rate of escape was 
motivated by Nagnibeda and Woess. 



Our aim is to compute formulas for the rate of escape of random walks on regular languages and free 
products by amalgamation of finite groups. In Section g we compute the rate of escape of random walks on 
regular languages, while in Section g we compute it for random walks on free products b y am algamation. 



In Section ^^ we compute the rate of escape analogously to Section 2.2 and in Section 3.3 we compute 
it by an application of a theorem of Sawyer and Steger (pl|). In Section 3.4 we use the algebraic group 
structure of free products by amalgamation to compute the rate of escape with respect to the natural word 
length. This approach is based on a technique which was already used by Ledrappier ( p3| ) and Furstenberg 
(0). Finally, in Section || we give sample computations. 
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2 Rate of Escape of Random Walks on Regular Languages 
2. 1 Regular Languages and Random Walks 

Let yl be a finite alphabet and e be the empty word. A random walk on a regular language is a Markov 
chain on the set A* :— lj„>j A" U {e} of all finite words over the alphabet A, whose transition probabil- 
ities obey the following rules: 

(i) Only the last two letters of the current word may be modified. 

(ii) Only one letter may be adjoined or deleted at one instant of time. 

(iii) Adjunction and deletion may only be done at the end of the current word. 

(iv) Probabilities of modification, adjunction or deletion depend only on the last two letters of the current 
word. 



Compare with Lalley (14i. The hypothesis that transition probabilities depend only on the last two letters 
of the current word can be weakened to dependence of the last K >2 letters by a "recoding trick", which 
is also described by Lalley. In general, a regular language is a subset of A* whose words are accepted by 
a finite-state automaton. It is necessary that by each modification of a word of the regular language in one 
single step a new word of the regular language is created. The results below, however, are so general such 
that w.l.o.g. - for ease and better readability - we may assume that the regular language consists of the 
whole set A* . 

The random walk on A* is described by the sequence of random variables (X„)„gNQ . Initially, we have 
Xq — £. For two words w, w' € A* we write ww' for the concatenated word. We use the following 
abbreviations for the transition probabilities: for w € A* , a, a', 6 G A, 6', c' G A U {e}, n e Nq, let be 

P[X„+i = walh'd I X„ = wah\ = p{ab, a'b'c'), 

P[X„+i - 5V I X„ = a] = p(a, 6V), 

P[X„+i=6'|X„ = £]=p(e,6')- 

If we want to start the random walk atwEA* instead of e, we write for short P^ [ • ] := P[ • | Xq = w] . 
Suppose we are given a function I : A ^ [0; cxj). We extend / to A* by defining l{aia2 ■ ■ ■ an) '■= 
S"=i K^i) for o,iO'2 ■ ■ -0.71 G A"- Additionally, we set /(e) := 0. If I (a) = 1 for each a E A, then / is just 
the natural word length which is denoted by | • |. If there is a non-negative constant £ such that 

lim — — £ almost surely. 



then £ is called the rate of escape with respect to I. Malyshev ( |17| ) proved that the rate of escape w.rt. the 
natural word length exists. Furthermore, by Malyshev follows that the rate of escape w.r.t. I is zero if and 
only if (^„)„gNo is recurrent. Our aim is to compute a formula for £ in the transient case. Therefore, we 
assume from now on transience of {Xn)neNo- 

Moreover, we assume that the random walk on A* is suffix-irreducible, that is, for all w E A* with 
P[X„i = w] > for some m e N and for all ab E A^ there is some n G N such that 

3wi E A* : Xn = wwiab,yk < n : \Xk\ > \w\ Xq = w > 0. 
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If suffix-irreducibility is dropped, then the rate of escape may be non-deterministic; e.g., if A = {a, b} 
with l{a) = l{b) = 1 and p{aa, aaa) ~ p > 1/2, p{aa, a) = p{a, e) = 1 — p, p{e, a) = p{e, h) — 1/2, 
p{bb,bbb) = q > 1/2, p{bb,b) = p{b,e) = 1 — q with p ^ q, then l{Xn)/n converges only non- 
deterministically. 

2.2 The Rate of Escape 

The technique we use to compute £ was motivated by Nagnibeda and Woess ( |l9i Section 5). For k £ No 
we define the k-th exit time as 

Gfc := supj™ e No I \X„r\ = k}. 

As the alphabet A is finite and the random walk on A* is assumed to be transient, we have e^ < oo almost 
surely for every k E No. Furthermore, we write Wfc :— Xe^ and ife := e^ — e^-i with e_i := 0. We 
show at first that (W^, ifc)fc>3 is a Markov chain. For this purpose, we introduce some useful functions: 
for a,b,c E A and real z > define 



Hiab,c\z) := ^ P,6[X„ = c, Vm < n : |X„.| > l] z", 

n=l 

^{abc) := J2 P(^'=' «'^'c') ■ (l - H H{b'c', d\r 



a'b'c'eA^ deA 



Observe that 



\bc[Xn = abWm < n : \X„\ > 2] = ^bc[Xn ^ b' ,ym < n : \X„,\ > l] , 



as the transition probabilities depend only on the last two letters of the current word and in each step only 
one letter may be deleted. Thus, the number ^{abc) is the probability of starting at aba G A'^ such that 
l-'^nl > 4 for all n > I, and it does not depend on the letter "a". Furthermore, let be [ai . . . a„]3 := 
an~20-n-ian, if fli . . . a„ € A* with n > 3. With this notation we get: 

Proposition 2.1 The stochastic process (Wfe, ife)fe>3 is a Markov chain with transition probabilities 

IP[Wfe+i =Xfc+i,ife+i = nfc+i I Wfe =2;fe,ife = Uk] 

= ^^^^^ ■ ^-'^ [^"^+1 = ^''•+1'^* e {1, • ■ • , nk+i} : \X,\ > k] 
fornk,nk+i G N, a;fe,.Tfe+i e A* with \xk\ = k, \xk+i\ = k + l ant/ P[Wfe ^ Xk,ik = "fc] > 0. 

Proof: Let be no,ni, . . . ,nk+i G N and xo,xi, . . . ,Xk+i G A* with \xj\ — j for j e {0, 1, . . . , fc + 1}. 
Define the event 

[W^ = x^, i^ = n™] :- [yj e {0, 1, . . . , m} : W, - x,A, = n,] , 

where m S {k,k + 1}. With this notation we get 

p[wg = xSMg^4] = 



Vj€{0,...,fc}VAe{0,...,n,}: 

\Xni^ h«3-i+A| >j,Xni^ h«3 ~ ^j 

Vje{0,...,fc}VAe{0,...,n,}: 



P,JVn>l: |X„| >A:] 
(.{[xkh)- 
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Analogously, 

pT Vje{0,...,fc}VAe{0,...,n,}: 

•P,, [Vi e {1, . . . ,nfc+i} : \X^\ > k, Xn,^, = Xk+i] ■ ^{[xk+ih). 
Thus, under the assumption that P[Wq = Xq, ip = tiq] > we obtain 

*a;t,[Vi e {1,. ..,nk+l} ■■ \Xi\ > k,Xn^^^ =^ Xk+l]. 



^{[xk+ih) 



^([Xk] 



n 



Observe that P^,^ [\/i e {1, . . . , rik+i} : \Xi\ > k, X^^^^ = Xk+i] depends only on Uk+i, [xkjs and 
[a^fe+ila- We use this observation to construct a new Markov chain on the state space 

Z := {{abc,n) eA^ x N | 3de G A^ : Pde[^n = abc,ym e {l,...,n} : \Xm\ >2]}, 

where A := {abc G A'^ \ ^(abc) > 0} with the following transition probabilities: 

q{(abc,n), {a'b'c',n')) = %^ • Pabc [^„ = aa'b'c'^i € {1, . . . ,n'} : \X,\ > 4]. 

£,(abc) 

Observe that 

P[Wfe+i = Xfc+i,ife+i = rik+i I Wfc = Xfc,ifc = Uk] = q{{[xk]3,nk), ([xfe+i]3, nfc+i)) 

for fc > 3 and that the transition probabilities do not depend on rife. This provides that also ([Wfeja) , ^3 
is a Markov chain on A with transition probabilities 

q(abc,a'b'c') = ^ q{{abc,nabc),{a'b'c' ,n')) , 

n'SN 

where the Uabc's. on the right hand side of the equation may be chosen arbitrarily. Observe that [Wfejs 
may only take a finite number of states, since the alphabet A is finite and |[Wfe]3| = 3. At this point we 
need the above made assumption of suffix-irreducibility; this provides that ([W^Js) is irreducible and 
therefore has an invariant probability measure i^. 

Lemma 2.2 Let be abc G A^ and n G N and define 



7r(a6c,n):= ^ iy{def) q{{def,ndef)Aabc,n)), 
where ridef can be chosen arbitrarily. Then it is the unique invariant probability measure of {\W k]?^: ife) , j^„. 
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Proof: It is a straightforward computation to prove the lemma: 

^ TT{ghi,s)q{{ghi,s),{abc,n)) 

(ghi,s)G2 

= ^ ^ iy{def) q{{def,ndef),{ghi,s)) q{{ghi,s),{abc,n)) 

ighi,s)eZ def^-J^ 

= X] (l{{9hi,ngM),{abc,n)) ^ iy{def)^q{(def,ndef),{ghi,s)) 

ghieA^ defeA^ "^f* 

= X! q{{9hi,nghi),{abc,n)) v{ghi) ^ 'K{abc,n). 

ghieA' 

D 

Define g : Z ^ N : (abc, n) i-^- n. An appHcation of the ergodic theorem for positive recurrent Markov 
chains yields 



-r'^9{\^kh,h) ^ "" u ^ ^^°°> g{abc,n)d'K almost surely, (2.1) 

i=3 -^ 



if the integral exists. Our next aim is to ensure finiteness of this integal and to compute a formula for it. 
For this purpose, we define 



G{ab,cd\z) := ^ P„b[X„ = erf, Vm < n : |X„| > 2] z", 

oo 

IC{ab,cde\z) := ^ P„b[^n = crfe,Vm e {1, ..., n} : |X„| > 3] z" 

n=l 

where a, b,c,d,e E A and z > 0. We have the following linear system of equations: 

G{ab, cd\z) — 5ab{cd) + y, p{o-b, c'd') ■ z ■ G{c'd' , cd\z) + 

c'd'eA^ 

+ Y^ p{ab,c'd'e')-z-YH{d'e'J'\z)-G{c'f',cd\z). (2.2) 

c'd'e'eA^ feA 

Moreover, we also have the following finite system of equations: 

H{ab,c\z) = p(ab,c)-z+ > p{ab,de) ■ z ■ H{de,c\z) 

deeA^ 

+ J2 P{ab,def)-z-Y,H{ef,g\z)-H{dg,c\z)- (2.3) 

defeA^ geA 



54 



LorenzA. Gilch 



compare with Lalley (n^. The system ( 2.3 ) consists of equations of quadratic order, and thus the functions 
H{-, -Iz) are algebraic, if the transition probabihties are algebraic. If one has solved this system, then the 
linear system of equations ( [2.2[ )canbe solved easily. In particular, the functions G{-,-\z) are also algebraic 
for algebraic transition probabilities. Observe that we can write 






/C(6c,a'6'c'|l), 



providing i' can be computed if (2.3) can be solved. Turning back to our integral in (2.1) we can now 
compute: 

Proposition 2.3 We have linife^oo ^k/k = A almost surely, where 

({abc) d 



A := J2 ^{def) 



adef) dz 



abc.def^A 

Proof: We compute straight-forward: 

g{abc, n) dir 

^ n- ^ iy{def) ■q{{def,ndef),{abc,n)) 

{abc,n)eZ defeA^ 

^(abc) 



X! Pi^f^'^gh)- z-G{gh,bc\z) 

gheA^ 



= E -(def) Y: 



defeA" 



{ahc.n)^2. 



adef) 



def [Xn = dabc,ym € {1, . . . , n} : |X„| > 4] 



E Krfe/) 



abc,defGA 



C{abc) 



Y^ n ■ Prfe/ [^„ = dabc, Vm e {1, . . . , 71} : |X„| > 4] 



n&\ 



E Krfe/)-|g^4[/C(e/,a6c|z)] 



abcMef^A 



Cidef) dz' 



Finiteness of the integal is ensured if all functions i/(-, ■\z) and G{-, ■\z) have radii of convergence bigger 
than 1. But this follows from Lalley (jl4|): he proved that the Green functions of random walks on regular 
languages have radii of convergence bigger than 1. D 

Now we can state an explicit formula for the rate of escape: 
Theorem 2.4 There is some non-negative constant H. such that 

i = lim = — > almost surely. 



where 



A:= Y K'ie/)/(a)|^/C(e/,a5c|l). 



abc^defGA 

In particular, linin^oo |-^n|/^ = 1 / A almost surely. 



adef) 
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Proof: With h : Z ^'H defined by h{abc, n) :— l{a) we obtain 

KX.J 



- V'/i([Wfc]3,ifc) "^°°> hdTr= lim 

fc=3 "^ 

Simple computations lead to the following formula for this limit: 

A:=fhd7r= Yl v{deJ)-l{a)-^^-JC{ef,ahc\l). 

ahc,def(^A 

Defining k(n) := max{fc e No | efe < n} we obtain analogously to Nagnibeda and Woess ( [l9[ Proof of 
Theorem D) 

.= lim&l=limMfM^iiH A^O. 

D 
Observe that for algebraic transition probabilities the rate of escape is obtained by solving the algebraic 



system of equations (2.3). This yields that the rate of escape is also algebraic, if the transition probabilities 



are algebraic and l{-) takes only algebraic values. 

3 Rate of Escape of Random Walks on Free Products by Amal- 
gamation 

In this section we compute three formulas for the rate of escape of random walks on free products by 
amalgamation of finite groups. This class of structures form special cases of regular languages. 

3. 1 Free Products by Amalgamation 

Let be 2 < 7- e N. Consider finite groups Fi, . . . , F^ with identities ei, . . . , e,. and subgroups Hi C Fi, 
. . . , Hr C F,.. We assume that Hi, . . . ,Hr are isomorphic, that is, there is a finite group H such that there 
are isomorphisms (pi : H ^ Hi, . . . ,(pr : H ^ H,.- Thus, we identify in the following each Hi with 
H. To explain the concept of free products by amalgamation, we give at first a simple example: consider 
Fi = F2 = Z/dZ, d e N even, and the subgroup H — Z/2Z. Let Fi be generated by an element a, 
and F2 by an element h. The free product by amalgamation Z/dZ *z/2Z '^/dl, consists then of all finite 
words over the alphabet {a, 6}, where we have the relations a'^/'^ = b'^^^ and a'^ = b'^ = e. That is, any 
two words which can be deduced from each other with these relations represent the same element. The 
relation a'^^^ — b'^/'^ means that the subgroup Z/2Z in both copies of Z/dZ are identified. E.g., for d = 4 
it is a?bab^ — ab^a? = aba. To help visualize the concept of free products by amalgamation, we may also 
think of the Cay ley graphs Xi of F^ . We connect the graphs Xi by identifying the subgroups H — Hi; at 
each non-trivial coset of H in all graphs Xi we attach copies of Xj, j 7^ i, where the coset is identified 
with H of the copy of Xj. This construction is then iterated. 

We explain below free products by amalgamation in more detail. The quotient Ti/H consists of all sets 
of sets yH = {yh \ h e H}, where y G F^. We fix representatives Xi^i — Ci, Xi^2, ■ ■ ■ , Xi^m for the 
elements of Ti/H, that is, for each y £ Ti there is a unique Xi^k with y e Xi^kH. We write F^^ := Fi \ H 
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and Ri :— {xi^2, ■ ■ ■ , Xi^m} with Ui — [Ti : H]. For any element x S Ul=i ^i '^^ ^^^ '''i^) '■— *' if 
X e rf , and T(a;) := 0, if a; e iJ. 

The free product of Fi , . . . , F^ by amalgamation with respect to H is given by 

F :— Fi *H F2 *if • • • *H Tr, 

which consists of all finite words of the form 

X1X2 ■ ■ -Xnh, (3.1) 

where h E H, n E f^o and xi, . . . ,x„ S UI=i -^i such that T{xi) ^ T{xiJ^\). In the following we 
will always use this representation of words. Suppose we are given a function I : IJ^^^ ^i ~* [0;oo). 
Then we extend I to a length function on F by setting l{x\ . . . Xnh) := J2l=i K^i)- The natural word 
length is defined to be ||xi . . . Xnh\\ :— n. In particular, l{h) ~ \\h\\ = for all h E H. For two words 
wi = xia;2 • ■ ■ Xmh, W2 — 2/1^2 ■ ■ • Unh' G F a group operation is defined in the following way: first, con- 
catenate the two words, then replace hyi in the middle by y'lhi such that y[ is a representative for the class 
of hyi. Iterate the last step with hiy2 and so on. Finally, we get a word of the form xi . . . Xny'i ■ ■ ■ y'nhn 



with hn E H, that is, we get the requested equivalent form (3.1) for the concatenated word wio 'W2- Note 
alsothatw"^ = ft,~^a;~^ ... a;j~^ is the inverse of lui and can be written in the form of (3.1). The empty 
word e is the identity of this group operation. Observe that each F^ is a subset of F. 

Suppose we are given probability measures /i^ on F^. Let ai, . . . , a^ be strictly positive real numbers 
such that J2l=i '^i = 1- A. probability measure on F is given by 

aT(x)l^T{x){x), ifa^eULiTf 
K^) := { LLi OitHiix), ifxEH 
0, otherwise 

The n-th convolution power of /i is denoted by /i^"). The random walk {Xn)neNo on F is then governed 
by the transition probabilities p{wi, W2) := ij.{'w^^W2), where wi, W2 G T- Initially, Xq :— e. 

Lemma 3.1 The random walk on F is recurrent if and only ifr = 2= [Fi : H] = [F2 : H]. 

Proof: Assume r = 2 = [Fi : ff] = [F2 : H]. This provides H < Fi,F2, that is, (Fi * F2)/if ~ 
(Ti/H) * (F2/i/) and Ti/H ~ Z/2Z ~ T2/H. Since it is well-known that each random walk on the 
free product (Z/2Z) * (Z/2Z), which arises from a convex combination of probability measures on the 
single factors, is recurrent, the random walk on F also must be recurrent. 

Assume now that r = 2 = [Fi : if] = [F2 : H] does not hold. Then either r > 3 or w.l.o.g. 
[Fi : H] > 3. In both cases, F is non-amenable (for further details see e.g. Woess (e3, Th.10.10)). With 
Woess (p4l Cor.12.5) we get that the random walk on F must be transient. D 

From now on we exclude the case r = 2 = [Fi : Hi] = [F2 : 7/2]- In the following three subsections we 
want to compute three explicit formulas for the rate of escape of our random walk on F. The first approach 
uses the technique from the previous section, while the second approach arises from an application of a 
theorem of Sawyer and Steger (pi|). The third technique uses the group structure of F, but is restricted to 
the computation of the rate of escape w.r.t. the natural word length. 
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3.2 Exit Time Technique 

We use the technique developped in Section 2.2 to compute I. Notice that F is a special case of a regular 
language and our random walk on F fulfills the assumptions of our investigated random walks on regular 
languages: starting from a word xi . . . Xnh G F we can only move in one step with positive probability to 
a word of the form 

• xi . . . Xn-ix'h' with x' h' e F^, >, namely with probability fiih^^xZ'^x' h'), or 

• xi . . . XnXn+ih' with Xn+ih' € Ur=i i^T(x„) ^f > namely with probability n{h^^Xn+ih'), or 

• xi . . . Xn~ih' with h' G H, namely with probability pi{h^^x^^h'), 



: ■^n+ 



i,< e ULi -R* and /i, /i' e iy. 



where xi, 

We may now apply the technique of Section [2.2| with some slight modifications and simplifications. 
The exit-times are now given by 

Gfc := sup{m e No | ||X™|| = k}. 

Analogously, W^ := Xe^ and ife := e^ — efe_i. We define for any x,y £ Ri, i G {1, . . . , r}, h, h' e H, 



H{xh,h'\z) 



El 



xn -^^n 



h',\fm<n: \\X„i\\ > l] z", 



Y, fii9hi)-[l- Y, H{gh,M^)) >0, 



h2£H 



G{xh,yh'\z) := ^ P,4X„ = z>', Vm < n : ||X„,|| > l] z". 



ri=0 



The functions H{xh, h'\ z) a nd G(xh, yh'\z) can be computed by solving a finite system of non-linear 
equations; compare with (2.2) and (2.3). Analogously to Proposition 2J^, it is easy to see that (W^, ifc)^^™ 
is a Markov chain. The state space Z can now be restricted to 



Zr '■— < {xh,n) 



e [JR^,heH,nem. 

2=1 ' 



Define [xi . . . Xnh] := Xnh. Then ([Wfc])fcgN is also a irreducible Markov chain on a finite state space 
with invariant probability measure v. Thus, we get 



A: 



E 



iy{yh 



x/i,2//i'eur=irf 

T{xh)^T{yh') 



y p{yh' ,yh'w) ■ z ■ G{h'w,xh\z) 



-w&T" 



and 



A = 



E 



T(xh)^T(yh') 



^{r{yh')) ■ dz 

Hyh') ■ f ^.^''^,^1 ■ i{^) ■ E Piyh',yh'w)-Gih'w,xh\i). 

T(a;) 



Z = l 



Finally, we obtain: 
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Corollary 3.2 

lim&l.^ almost surely. 

3.3 Computation by Double Generating Functions 

In this section we derive another formula for the rate of escape with the help of a theorem of Sawyer and 
Steger (Gil Theorem 2.2), which we reformulate adapted to our situation: 

Theorem 3.3 (Sawyer and Steger) Suppose we can write for some S > 

£{w, z) := E {y^ w'(^") zA = ^y^ for w, z G (1 - <5; 1), 

where C{w, z) and g{w, z) are analytic for \w — l|,|z— 1| < S and C(l, 1) 7^ 0. Then 

almost surely. 



l{Xr.) rw^ , _ ^g(l:l) 



SI.9(1,1) 
Moreover, if{Xn)neNo ''^ '^ reversible Markov chain, then with g{r, s) :— g{e~^, 6~*) 

Yn-ne „^oo ^^,^ 2, . , , 2 -&g(o. 0) + ^e£^m o) - e'^m, o) 

■= > jyiO,a) m law, where a = — -^-^ ^p^^ ^^^-^ . 

V^ ^5(0,0) 

We remark that ( pi[ , Theorem 2.2) also comprises a central limit theorem. Similar limit theorems are well- 
known in analytical combinatorics, see e.g. Bender and Richmond ([l|) and Drmota (Q), (|]). We show now 
how to write the expectation in the theorem in the required way. Let sh be the stopping time of the first 
return to H after start at e, that is, sh = inf{l < to e N | X„i <E H}. For h e H, i e {1, . . . ,r}, 
a; e Fi \ _ff and z e C we define 

L{h, x\z) := ^ P/i [X„ ^ x,SH > n] z" = ^ p{h, y) ■ z ■ G{y, x\z). 

Additionally, we set L{h, h\z) := 1 and L{h, h'\z) := for h' E H \ {h}. With this notation we have 

£{w,z) = J2 J2 ^^"^6, a;) z" u)'(^) = ^ ^ G(e, /i|z) i(/i,a;|z) u;'(^). 

Setting 

C+{w,z) := J2 He,x\z)w^^'''> and 
xGrf 

C,{w,z) ■■= Y. J2 i(e,xi...x„/i|z)w;'(^i-^"''), 

n>l xi ...a:n,/iGr, 
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we have 

r 

xer i=i 

We now rewrite Ci{w, z): 

C,iw,z) = C+{w,z)-{l + J2 E i(e,X2...a;„/i|z)u;'(---"^)) 

n>2x2...x,Jier\H, 
X20^i 

r 



From (3.2) and (3.3) we obtain 



£ 



(u;,z) = l + E^ 



C^{w, z)£{w, z) 



yielding 



L(w, z) = 



-[ l + Ct{w,z) 
1 

1 Y^*" •C^(ii',z) 



l+CJ(w,z) 

Now we can write the expectation of Theorem |3 . 3| in the requested way: 



£{w,z) = ^G{e,h\z)^L{e,h-^x\z)w^^'' 
heH xer 

= J2G{e,h\z)Y,L{e,x\z) 



^i(x) ^^heHG{e,h\z) 



heH 



xer 



1-ELiT 



r C'[{w,z) 



+ CJ{w,z) 



Thus, we can apply Theorem 3^ with C{w, z) = J2heH ^("^i ^1-^) ^'^'^ 

£+(«;, z) 



g(u;,z) = 1-^7 



-^1 + Ct{w,z) 
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(3.2) 



(3.3) 



Corollary 3.4 The rate of escape w.r.t. l{-) is 



lim — = —- almost surely, 

n— ►oo n 12 



where 






and I2 — / 



Proof: Computing the derivatives of g{w, z) w.r.t. w and z leads to the proposed formula. 



D 
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3.4 Computation via the Limit Process 

In this section we derive another formula for the rate of escape w.rt. the natural word length || • ||. First, 

E[ll^nll]-Ell3ll/^^"^(5) ^nd E[||X„+i||]^ E 113511 M3)a*^"H5). 



ser 



g:Ser 



Thus, we have 



E[||X„+i||] -E[||X„||] =E/.(g) f{\\gXj - \\X,,\\) d^l^'^\ 

Since E[||X„||]/n converges to i = lim„^oo ||-^n||/'T^, it is sufficient to prove that this difference of 
expectations converges; the limit must then equal £. The process (X„)„gNo converges to some random 
element X^o valued in 



xia;2 •••el 



a;j e IJ Rj,T{xi) ^ r(xi+i) 



^1) 



in the sense that the length of the common prefix of X„ and X^o goes to infinity. We denote by X)x! the 
first letter of X^o and for g E IJi=i ^i *^ define 

'i, ifx(<^)^r,( 

Yg :- ;im_ |l5X„|l - |1X„|1 = { 



r{g) 
-1, ifX^^^eg-^H 

0, otherwise 



At this point we need the equation \\hx\\ — \\x\\ for h G H and x E T. This equation is, in general, not 
satisfied for other length functions. The Green functions G{x, y) = J2n>Q ^x[Xn = y], where x,y G Ti 
for any i e {1, . . . , r}, satisfy the following linear recursive equations: 

G{x,y) =Sx{y)+ ^ p{x,w)G{w,y) + ^ p{x,xwh) ^ H{wh,h'\l)G{xh',y). 



weFi 



xwhGV, 

\\xwh\\=2 



h'eH 



This system of Green functions can be solved, when the functions H{wh, h'\l) can be obtained by solving 
(2.3). We now define 

heH ger'^ h'eH 

By transience, X)i=i £•(*) = 1- Furthermore, P[Yg = 1] = 1 — g{T{g)) and 

nr, - -1] = E Fi^^^9-'h) ■ (1 - 9{r{g))) = ^-^$^ E G{e,g-^h). 



heH 



G(e,e) 



heH 



By Lebesgue's Dominated Convergence Theorem, 



E[||X„+i||] -E[||X„||] ^^=^J2 E ^'i9){nY, = 1] -p[r, = -1] 

*=i serf 
But this limit must be the rate of escape i. Thus: 
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Corollary 3.5 



(. — lim 



\Xr, 



n^oo Ti 



E 



^,{T^){l~g{^)) 



1 - g(») 
G(e,e) 



J2 J2^'(9)Gie,g-'h) 



gf=T^ heH 



As a final remark observe that the formulas of Corollaries 3.2,3.4 and 3.5 have complexities in decreasing 
order: while the computation of the rate of escape by Corollary 3.2 needs three systems of equations to be 
solved and derivatives to be calculated, the computation by Corollaries 3.4 or 3.5 needs only two systems 
of equations to be solved, while the formula in Corollary 3.4 deals also with derivatives. 



4 Sample Computations 
4. 1 A Regular Language 

Let be yl = {a, 6, c} and we set l{a) = l{b) = l{c) = 1. We consider the set C of all words over the 
alphabet A, such that in each w ^ C the letter h is the first letter of w or follows after the letter a and the 
letter c may only appear after the letter h; e.g., abcaba G £, but abcba ^ £. Consider the random walk on 
C given by the following transition probabilities: 

p{aa,aaa) = -, p{aa,aab) = -, p{aa,a) = -, p{ab,aba) = -, p{ab,abc) = -, p{ab,a) = -, 
6 3 3 3 2 

p{ba,baa) — -, p{ba,bca) — -, p{ba,bab) = —, p{ba,a) — -, 

p{bc,bca) = -, p{bc,a) = -, p{ca,caa) = -, p{ca,cab) = -, p{ca,a) = -. 

Note that it is not necessary to specify any further transition probabilities, as the formula for the rate 
of escape does not depend on the transition probabilities of the form P[X„+i = w' \ Xn — w], where 
w e {e, a, b, c}. The system of equations 2.3 is then 



H{aa, a 
H{ab, a 
H{ba, a 
H{bc, a 
H{ca, a 



-(H{aa, a\z) ■ H{aa, a\z) + H{ab, a\z) ■ H{aa, a\z) 



1 



z z z 

—H{bc, a\z) ■ H(aa. a\z) H — H{ba, a\z) ■ H{aa, a\z) H — , 
3 '6 2 



-[H{aa, a\z) ■ H{ba, a\z) + H{ca, a\z) ■ H{ba, a\z) + H{ab, a\z) ■ H{ba, a\z) + l), 



z z 

—H{ca, a\z) ■ H{ba, a\z) + — , 

z z z 

—H{aa, a\z) ■ H{ca, a\z) -\ — H{ab, a\z) ■ H{ca, a\z) -\ — . 



This system in the unknown variables H{aa,a\z), H{ab,a\z), H{ba,a\z), H{bc,a\z) and H{ca,a\z), 
where z appears as a parameter, can be solved with the help of Mathematica. With these solutions 
we can compute the modified Green functions G{-, -jz) by solving the linear system (1.2). Note that only 
G{aa,aa\z), G{ab,aa\z), G{ba,ba\z), G{bc,ba\z), G{ca,ca\z) are non-zero functions. Moreover, we 
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get 

^{aaa) = ^{baa) ^ ^{caa) :^ -{l - H{aa,a\l)) + -{l - H{ab,a\l)) , 

^(aab) = ^(bab)^^(cab):^ 1(1 ^H(ba,a\l)) + \(l-H(bc,a\l)), 

6 

?(aM - ^{1-Hiaa,a\l)) + ^{1-Hica,a\l)) + ^{1-H{ab,a)), 
aabc) = i(l-i/(ca,a|l)),e(M-|(l-^(«a,«|l)) + ^(l-^Ka|l))- 
Since v{abc) = ^ , , -j3 v{def) q{def, abc), we can compute the invariant measure as 

I'iaaa) = 0.32475, iy{aab) == 0.13194, ly(aba) ^ 0.12597, iy{abc) ^ 0.08021, iy{baa) = 0.05350, 
ly(bca) = 0.13095, iy{bab) = 0.02174, iy{caa) = 0.07844, iy{cab) ^ 0.05251. 

Now we have all necessary ingredients to compute A = 3.78507, and finally we get the rate of escape as 
£ = 0.264196. 

4.2 Z/dZ *z/2Z ^/dZ 

Consider the free product by amalgamation Z/rfZ *z/2Z Z/rfZ, d E N even, over the common subgroup 
Z/2Z. Suppose that Z/dZ is generated by some element a with a^ equal to the identity. Setting /ii (a) = 
/i2(a) — 1 and ai = a2 = 1/2 we get the following values for the rate of escape £ w.rt. || • ||: 



d 


6 


8 


10 


12 


£ 


0.24749 


0.40859 


0.46144 


0.47543 
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